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Sums of Random Variables 


6.1.2 Sums of Random Variables 


In many applications, we need to work with a sum of several random variables. In particular, we might 
need to study a random variable Y given by 

y=x 1 +x 2 + -+x„. 


The linearity of expectation tells us that 

EY = EX j + EX 2 + ■■■ + EX n . 

We can also find the variance of Tbased on our discussion in Section 5.3. In particular, we saw that the 
variance of a sum of two random variables is 

Var(T| +X 2 ) = Var(X,) + Var(X 2 ) + 2Cov(X 1 ,X 2 ). 


For Y = + X 2 + ••• + X n , we can obtain a more general version of the above equation. We can write 


( 72 71 \ 

Z x i> Z^l 

n n 

-a Cov(X ; -,X ) (using part 7 of Lemma 5.3) 

i= lj= 1 
n 

= XVar(X.) + 2XCov(X.,X.). 

2 = 1 7<y 


( n \ n 

-Z Var(X ; ) + 2 Z Cov(X.,X) 
2=1 J 2=1 2 <7 


If the X-s are independent, then Cov(X ; -, X) = 0 for i ± j. In this case, we can write 


/ " \ " 

IfX 1 ,X 2 ,...X n are independent, Varl / / X i = / ^ Var(X,). 

I /—1 / 2=1 


Example 6.2 

N people sit around a round table, where N > 5. Each person tosses a coin. Anyone whose outcome is 
different from his/her two neighbors will receive a present. Let Abe the number of people who receive 
presents. Find EX and Var(A). 
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• Solution 

o Number the N people from 1 to N. Let X■ be the indicator random variable for the /th person, 
that is, X i = 1 if the /th person receives a present and zero otherwise. Then 


X=X x +X 2 + ... +X N . 

1 

First note that P(X j = 1) = This is the probability that the person to the right has a different 

outcome times the probability that the person to the left has a different outcome. In other 
words, if we define H i and T i be the events that the /th person's outcome is heads and tails 
respectively, then we can write 

EXj = P(X, = I) 

= P(H t _ „ T,H i+ j) + P(Ti_ x ,H p T i+ ,) 

1 1 1 
” 8 + 8 ” 4' 


Thus, we find 


Next, we can write 


N 

EX = EX { + EX 2 + ... + EX n = ~. 


N N 


v-av(X) = i Var(X ; .) + Cov(X-, Xj). 

i —1 f=l j^i 


1 

Since X { ~ Bernoulli (-), we have 


1 3 3 

Va ^> = J' 4 ' IS' 

It remains to find Cov(X ; -, Xj). First note that X t and X- are independent if there are at least two 

people between the /th person and theyth person. In other words, if 2 < | / - /1 < N — 2, then 
Xj and X- are independent, so 

Cov(X ; , Xj) = 0, for 2 < \i-j\ <N~ 2. 

Also, note that there is a lot of symmetry in the problem: 

Cov(X l ,X 2 ) = Cov(X 2 ,X 3 ) = Cov(X 3 ,X 4 ) = ... = Cov(X N _ { ,X N ) = Cov(X N ,X { ), 
Cov(Xj,X 3 ) = Cov(A 2 , X 4 ) = Cov(X 3 ,X 5 ) = ... = Cov(A fV _ ,,A,) = Cov(A v ,A 2 ). 

Thus, we can write 
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Var(X) = NV, ar(Xj) + 2NCov(X l ,X 2 ) + 27VCov(Xj,X 3 ) 
3N 

= — + 27VCov(X 1 ,X 2 ) + 2A^Cov(X 1 ,X 3 ). 


So we need to find Cov(XX 2 ) and Cov(Xj,X 3 ). We have 


Thus, 


E[X x X 2 \ = P(X 1 = l,x 2 = 1 ) 

= P(H N , t u h 2 , t 3 ) + P(T N , //,, t 2 , // 3 ) 
1 1 1 
” 16 + 16 ” 8' 


Cov(Xj,X 2 ) = E[X ] X 2 \ - E[X^E[X 2 \ 
1 1 1 
” 8 ” 16 ” 16’ 


E[X x X 3 ] = P(X l = l,X 3 = 1) 

= P(H N , t x , h 2 , r 3 , // 4 ) + P(T N , //,, t 2 , // 3 , r 4 ) 
l l l 
” 32 + 32 “ 16’ 

Thus, 

Cov(Xj,X 3 ) = E[X x X 3 ] - E[X { ]E[X 3 ] 

1 1 

” 16 ” 16 ” °' 

Therefore, 

3 N 

Vdv(X) = — + 2/Vcov(2f h X 2 ) + 2iVcov(X 1 ,X 3 ) 

3 N IN 
16 + 16 
5N 
16' 


We now know how to find the mean and variance of a sum of n random variables, but we might need to go 
beyond that. Specifically, what if we need to know the PDF of Y = X x + X 2 + ...+X „? In fact we have 

addressed that problem for the case where Y = X x + X 2 and X f and X 2 are independent (Example 5.30 in 
Section 5.2.4). For this case, we found out the PDF is given by convolving the PDF ofXj and X 2 , that is 

/•OO 

/yO) =fx ] (y) *fxp ) = ) -JxfxYxp - x ) dx - 
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For Y = X 1 +X 2 + ...+X, we can use the above formula repeatedly to obtain the PDF of Y: 

/yOO =fx(y)*fx 2 (y) * ■■■ *fx n (y)- 

Nevertheless, this quickly becomes computationally difficult. Thus, we often resort to other methods if we 
can. One method that is often useful is using moment generating functions, as we discuss in the next 
section. 

<— previous 
next —> 
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